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ABSTRACT 


The problem of estimating the position of an extreme 
point of an unknown function of several independent variables 
is examined for the case where the dependent variable is known 
to be bounded, The classical method of least sequres is formulated 
as a quadratic programming problem to be solved numerically on a 
digital computer, where the coefficients of the fitted equation 
are determined subject to restrictions on both the independent 
variables and the dependent variable, 

Several two dimensional models were examined using synthetic 
experimental design techniques, The results, though not conclusive, 
indicate that the method of bounded least squares can be a useful 
computational tool in some two dimensional problems, [It remains 
to be shown whether the algorithm is useful in problems involving 


more than two independent variables, 
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NOTATION 


MEANING 


coefficients of the X 5 


upper bound on Xe 
lower bound on Y. 

upper bound on Y, 

lower bound on Xo 

residual. 

unknown true response function. 

number of coefficients in the fitted equation, 
number of experiments, 

number of independent variables. 

experimental region in n-space, 

distance between true and estimated extreme point. 
average extreme point error, 

the independent variables in coded form, 

the independent variables. 

the value of Xs at a true extreme point. 

the value of x 


i 


calculated value of the response. 


at an estimated extreme point. 


experimental value of the response. 


value of the response at an extreme point. 
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INTRODUCTION 


The method of least squares to fit a curve or surface tc a set 
of data points is well known in the literature, as are techniques 
for determining the extreme points of such a surface, In par- 
ticular, non-linear methods are available [10] to examine the 
surface in a particular region defined by bounds on the independent 
variables, 

While considering the special problem of approximating, by 
a quadratic equation, a complex probability distribution, it was 
proposed to make use of optimizing techniques which would give a 
good estimate of the particular combination of independent variables 
producing maximum probability, Since the equation was only an 
approximation, it was expected that errors would occur in the 
estimation and that further accuracy would be obtained by testing 
in the physical system, 

At this point it occured to the author that a large class of 
problems of this type must exist; i.e., certain independent variables 
are known to be bounded, and it is desired to find an extreme point 
of some function of these variables, which is itself bounded, 

A considerable body of literature on the theoretical nature 
of non-linear programming exists to consider the bounded independent 
variables (7] fr... and it seemed reasonable to extend these 
methods to treat the bounded dependent variable in such a manner that 
the extreme point of the true Response Surface could be more closely 


estimated, 





STATEMENT OF THE PROBLEM 


Consider a physical process or system under investigation 
which has at least one characteristic called the Response, such 
as cost, yield, power, etc. Assume that this Response is some 
unknown function, called the Response Function, of a set of 
independent variables and that these variables can each be quantita- 
tively fixed at a given value, or level. The observed response 
resulting from a combination of the variables, however, is the 
sum of the true Response and a random error which is distributed 
about a mean of zero with cance variance (no matter what the 
values of the system variables). 

Geometrically, the Response Function may be represented by a 
surface in (n¢l)-space called the Response Surface. The ex- 
perimenter has systematically proceeded to a particular region, 
R, in n-space (defined by the n independent variables) which is 
bounded by the planes x, = dy and x, = g, (1=1,2,..,n). He then 
wishes to find the levels of the independent variables for which 
the Response is extreme, restricting the independent variables to 
lie within R, 

To do this he must make the assumption that the Response 
Function may be adequately represented by some analytic function, 


In our case we shall assume that a quadratic function of the form 


Ms 


n 
Ze 45%; (1) 


n 
YFa+> bx, + 
i-l 1 j=l 
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will adequately represent the Response Function, at least in the 
vicinity of an extreme point, 

If we also assume that the experimenter has some prior know- 
ledge that the Response Function is bounded, then he should be 
able to make use of this knowledge in any procedure which estimates 
the coefficients of the quadratic equation used to locate the extreme 


point. 





CLASSICAL METHOD OF SOLUTION 


In a classical solution to a problem of this type, experiments 
would be performed at certain selected points in the region, R, 
and the method of least squares [9] would then be employed to 
determine the coefficients of the equation to be fitted, 
Once the quadratic has been estimated, the set of partial dif- 
ferential equations derived by differentiating the function, Y, 
with respect to each x, can be solved for the location of the 
extreme points, In order to remain within the region defined by 
the bounded independent variables, nonlinear programming methods 
may be applied to determine the position of the bounded extrema [10]. 
We notice that no restriction is placed on the Response, Y. 
The optimizing technique has given the set {x,"; i=1,..,nf which cor- 
responds to an extreme point, YPH(K) yee. X Ds of the fitted 
equation only. It is quite possible that Y" does not lie within the 
a priori bounds on the true Response and, in practice, further ex- 
perimentation could be performed at and near Egger.) in order 
to confirm the existence of the extreme point and to more exactly 
determine the Response at that point, If the research worker has 
the time and resources available to conduct the large number of 
experiments necessary to fit the quadratic by the method of least 
squares and then to converge on the true position of extreme response 


from a predicted position, such a method may be entirely adequate, 





It was felt, however, that such a procedure was not as efficient 


in predicting an extreme point as should be possible when a priori 


bounds on the Response are known, Accordingly, the classical method 


was examined to determine where a modification to the theory could 


best be made, 





THE METHOD OF BOUNDED LEAST SQUARES 


Though further experimentation is to be performed in the 
vicinity of the predicted extreme response, the problem of optimization 
is concerned not only with predicting response, but with predicting 
* 


tek 
»eee,X. ) With sufficient precision that the least 


the Y =H(x. 
e Y= (x, P 


number of experiments are necessary to converge to an extreme point, 
In the classical solution, two options are available. First, 
the bounds on the Response may be ignored and the position of maximum 
response obtained from the fitted equation may be taken as the best 
estimate of the values of the independent variables which will maximize 
(or minimize) the observed response. Secondly, the hyperplanes 
representing the upper and/or lower bounds on the Response may be 
intersected with the Response Surface obtained by the estimate of 
the quadratic equation, Only those portions of the fitted response 
surface lying within the bounded region would be searched for an 
extreme point (see figure 1). This method was not considered to 
yield an acceptable solution since the entire range of values of 
the independent variables corresponding to the portion of the fitted 
response surface outside the bounded region would give an extreme, 
restricted response. 
Situations can exist in which the fitted response surface 
varies greatly from the true Response Surface, both in shape and 
range of value over the surface, Thus, it was hypothesized that 


the extreme point of the fitted response surface could be moved 





closer in n-space to the extreme point of the true Response Surface 
if the quadratic equation used to represent the true Surface could 
be estimated subject to the restriction that no point on the fitted 


surface could fall outside the a priori bounds on the true Response 


(see figure 2). 
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FIGURE 1 FIGURE 2 


TRUNCATED LEAST SQUARES FIT BOUNDED LEAST SQUARES FIT 


Recall that equation (1) defined the fitted, or calculated 
e e 
response. If Y is defined as the observed response, then aA 
(k=1,...,m) are the sets of response values obtained when m dif- 
ferent combinations of values of the x, are 1) set as levels in 
t 


experiments where Y is observed and 2) used to calculate Y from 


the fitted equation. Then, 


m 
<2 
c= > Gy sat) (2) 





is the sum of squares of the residuals, The sum, G, is sometimes 
referred to simply as the Residual, 
Thus, the classical least squares method of estimating the 


coefficients may be modified as follows: 


Minimize G with respect to all coefficients of the x, (3) 


subject to gs, = x, = qd; (f=1,...,n) (4) 


i 


ande# y, = £ (k=1,...,™) (5) 


k 
where n is the number of vartables and m is the number of experiments 


(data points). In Appendix A it is shown that an equivalent form 


of (3) is to Minimize Fy with respect to all A, » where 

ong a ~ > 2 

Ect 2. CA, + ra CK,A, (6) 
and that (5) may be restated as 

F, 2 0 (j=2,...,2me1) (7) 


j 


Non-linear programming methods designed to accept problem state- 
ments in the above form, where the constraints are linear in the 
unknowns, are classed as quadratic programming. The particular 
algorithm used in this paper is due to Klingman’ [8], and was selected 
for its general application to the case where non-linear constraints 
are encountered in addition to bounded Response, as well as its avail- 
ability in finished program form. 

lone program originally published in Klingman's thesis was 


modified after private communications with W, R, Klingman and Dr. 
D, M, Hinmelblau, University of Texas, Austin, Texas. 





EXPERIMENTAL PROCEDURE 


Almost any convenient and reasonable method may be used to 
select the points at which the experiments are to be performed, 
In keeping with the image of an economy-minded experimenter, how- 
ever, it was decided to make use of the techniques of composite 
design due to Box f1] [4]. As shown in Table I, a considerable 
reduction in the number of points to investigate is possible when 
the 2" factorial design [ 5] is augmented rather than using the a 
factorial design usually employed when quadratic effects are being 
observed, 

TABLE I 


COMPARISON OF COMPOSITE DESIGN 
AND FACTORIAL DESIGNS 





no, of 
variables 


In order to simulate actual experimentation, a hypothetical 
physical system was represented by an analytic equation, For each 
combination of independent variables selected by the design program 
in Appendix B, the Response was evaluated and a random error dise- 
tributed with zero mean and constant variance was added to it to 


obtain YY (k=1,...,m). Using the data points thus generated, the 





coefficients of the quadratic equation were estimated by 1) the 
classical method of least squares [6] [9] and 2) the method of 
bounded least squares (Appendix 8B). This procedure was repeated 
until a total of ten estimates of the equation were obtained for 

a constant response error variance, for each of four analytic 
equations tested, the independent variables being set at the same 
levels for both methods. Each of the fitted equations was then 
solved for an extreme point in the design region, The distance, 

in nespace, between the true extreme point and the extreme point of 
each fitted equation was determined, Finally, for each case, consisting 
of ten runs for a particular equation, the distances were averaged 


to obtain the average extreme point error, r. 
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RESULTS 


For each case, the distance in ne-space between the true and 
estimated position of extreme Response was found using the relation 


2 of - x97 


iz] 


(8) 





and then averaging over the number of runs to obtain r. This 
procedure was followed for the results of the classical least 
squares fit and the bounded least squares fit for each case, 
Numerical Results 
2 & 


CASE ONE : Y = 4X) Xo ~ 2x, - Xo 


The response error variance was set at .25 and the region, R, was 


1 


and an a priori upper bound on the Response was assumed to be 1,0. 


defined by f(x, Xo): O=x_£2, oFx, £2} . A maximum is located at (1,1) 


Using the method of bounded least squares, the estimated maximum was 
located 12,7 percent closer to the true maximum than by the classical 
method, 
CASE TWO ; ytone + 2x? + 2x? - 2x + 10 | 
The response error variance was set at 1,0 and the region, R, was 
defined by ix: “25x ae An a priori upper bound on the Response 
was assumed to be 15.0 and two maxima are in R; a local maximum at 
x =-1,0 and a global maximum at x = 2.0. Using the bounded least 
squares method, the estimate of the extreme point was only 1.2 per- 


cent closer to the true maximum than by using the classical method. 


This difference was found to be completely submerged in the effect 


ll 


—— 





of response error variance upon the location of the maximum, 


TABLE If 


COMPARISON OF MEAN EXTREME 
POINT ERROR FOR CASE ONE 


0.7007 0.6103 0.4914 | 0.7188 06,6403 
7614 .6518 4219 rov2L =, D986 
~/607 =.6748— 4037 6647 .6228 
-6593 .5934 ,5304 ok77 = 59758 
-6403  .6133 .5282 6961 .6568 
~7932 = =.6993 .3647 -6312 .5483 
©7650 8 .6494 .4219 06181 .6277 
-6004 .5493 .6022 2/293 = =.6308 
.0000 = ,0000 1.4142 29742 = 5389 
.2386 8 =.4357) =, 9476 4303 «65787 


3 
8 
7 
6 
5 
4 
3 
2 
1 





CASE THREE : Y = 222322222 = 5 


(x, + 1)” + Xo + 10 


The response error variance was set at .0001 and R was defined 
by {(x45%5): -4 = x) = 4, 4 = Xo S 4} . The Response Surface 
ig symmetrically oriented about a maximum located at (-1,0), and 
an a priori upper bound of 1.0 was placed on the Response. Both 
methods of fitting the experimental points resulted in identical 


estimates of the maximum at (0,0) for all runs, It should be noted 


that the Response Surface is very shallow outside that area enclosed 


12 


we, 





by a cylinder of radius 1.0 which is centered at (-1,0). 


TABLE III 


COMPARISON OF MEAN EXTREME 
POINT ERROR FOR CASE TWO 





0.5669 1.4331 0.5706 1,4294 
2603 1.4397 - 9670 1.4330 
. 5488 1.4512 2853 1.4147 
- 5603 1.4397 9623 1.4377 
» 9636 1.4364 2897 1.4103 
5431 1.4569 - 5670 1.4330 
5540 1.4460 29735 1.4365 
- 5400 1.4600 . 5809 1.4191 
~9702 1.4298 <2057 1.4463 
9636 1.4364 - 2980 1.4020 
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= 3 
CASE FOUR ;: Y = a 3% 1X5 


The response error variance was set at 01 and an a priori lower 
bound of -1.69 was placed upon the Response, The region, R, was 
defined by 4 (x5 5%5): = I=x,=3, -1£x,£2 . There is a saddle point 
at (0,0), a minimum at (2.25,1.5), and the global minimum for R is 


located at (-1,-1). Both methods correctly estimated the position 


of the minimum for all runs, 
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Computational Results 


Program DESIGN required about one minute to compile and 
execute for two variables, including printout and punch, Program 
FIT required approximately three minutes to compile and four seconds 
to execute for each run, The minimum fractional change in both the 
coefficients being estimated and the value of the Residual being 
tested was set at 10°”. In his thesis, Klingman [3] gives a compile 
time of about one and one-half minutes for the quadratic program 
(subroutines DIRECT, PATSER, EXPSER, GRAD, SUMS and OUTPUT in program 
FIT of this paper). 

The program due to Dillon [¢} was used to fit the quadratic by 
the classical method, That program consists of the elements of 
programs DESIGN and FIT with the equations from Krase and Cyl-Champlin 
[9] substituted for the subroutine package which comprises the 
quadratic program portion of FIT, The program required one and 
one-half minutes to compile and less than one second to execute for 
each run, Thus, the classical method of solution required about 
one-half the total computer time required by the bounded least 
Squares method. As mentioned before, no attempt was made to reduce 


either compile or execution time, for either program, to a minimum, 
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CONCLUSIONS 


The algorithm presented here was expected to provide a closer 
estimate, in terms of the physical values of the independent variables, 
of the location of a point of extreme Response, It was assumed that 
the method would be of greatest value in cases where the Response 
Surface 1) is non-symmetrical about an extreme point in the interior 
of the region being investigated or 2) has more than one extreme point 
in the same region. 

In no case tested did the algorithm provide worse estimates of 
the true extreme point than did the classical method. For cases 
three and four, where the Surfaces were symmetric, and oriented with 
an extreme point at the boundary, no particular advantage accrued 
from using the method of bounded least squares. In case two the 
results were inconclusive, and case one did not produce the desired 
improvement over the classical method, even though a distinct im- 
provement was observed, 

For one and two dimensional problems, it is felt that the 
advantage of the system is outweighted by the disadvantage of 
observing the Response at only a small number of points, Any 
method involving least squares requires enough points to adequately 
represent the Surface being approximated, In the bounded least 
Squares method, where the advantage lies in estimating an extreme 
point of a complex surface, composite design point selection does 


not choose enough points to adequately define the surface, Further 
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tests should be made to determine the minimum number of points 
necessary to permit the method of bounded least squares to enjoy 
a distinct advantage over classical methods, 

No suitable problems of dimensionality three or higher were 
found which permitted rigorous testing of this algorithm, Since 
the number of experimental points required for these problems 
becomes quite lerge (see Table 1), a significant advantage may 
be realized by the method of bounded Least squares, since additional 
information is included in the solution to the problem at no ex- 
perimental cost, The cost of further testing, as opposed to doubling 
the computer time, must be considered for each system investigated, 
before the decision is made to select any method which reduces 


the number of experiments, 
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APPENDIX A 


FORMULATION OF THE METHOD OF BOUNDED LEAST 


SQUARES AS A QUADRATIC PROGRAMMING PROBLEM 


All terms used in this Appendix have been previously defined 
except the following: 


JS: magnitude of the bounds on the coded values of all the 
independent variables, Xo 


K ; constant due to orthogonality requirement which permits 
independent evaluation of each coefficient, 


B_, B , (BB) ; coefficients of the orthogonal quadratic 
07 i 1j 
equation, for coded Xie 


(NOTE : double letter symbols enclosed by ( ) refer 
to names of single variables.) 


The form of the quadratic equation with which we desire to fit 


the experimental data is 


n n ”) 
= Bt 2 BX, + pa (BB) ,,(X," = X) 


f= 


zM- 


th 
2 (BB) 5 sX4%; Fee 


tle 


so that the sum of squares of the residuals may be writted as 


ni j ”) 
G = a (Y, - Y,) 
ta t ¢ 
2 > 2 > 
2 > (Y,)° + Yy - 2 me (A=2) 
ke] k k?1 k k=1 kk 


Simplifying each tern, 


t 
2 rs 
“ (Y¥,)° * constant Z (A-3) 
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and 


Tm n a 
(CBB), .X,,X,,)2 (A~4) 
‘22 Te pst pene) Le 


where all other terms can be shown to be zero. Then, using the 
rélations developed by Krase [9] for classical least squares 


theory using orthogonal designs, 


1 om 
A 2 = 
K Sm 2 X oy for any 171,2,...,n (A- 5a) 
m k=l] 
i n 2 n 
S—(2 - 26) = (2 /m (A~ 5b) 
m 
2 - n n 
d° = (2 /m- 2) (A- 5c) 
2 
= 2 2 4 
= (Ky, = KR) = 2d for all i=1,...,n (A- 5d) 
k=1 
= re ee = 
X ) ne 4 for all isfFj (A-5Se) 
fel ik jk 
~ 2 
> (X,,° °K) = 0 for all i#1,...,n (A-5£) 
ke] 


it is éasily shown thet 


om Y= mB, mB ss mK > B2 By 


k=] i] 
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(continued) 7 Pa :. (BB), 4 


. (A-6) 


n 
te (BB) 
iz} 2 iy 


The last term of (A-2) is a straightforward sum of multiplica- 


tions, When terms are combined, 


i=l jri k= 1 
~ B, 42 (X.,Y i 
f=i | ei 
> 2 yyy 
- (BB) \2 n(x - | 
cam ii f=, kik 
- (BB), (2 Y. Xone) (A-7) 
i=l fei fey i ik GK 
Then simplifying 
nh n 
C= Ze iZAn ot a Z,B, + +> > (22) ; (BB) 5 
L= i=1 j=l 
2 SS Ge y 2 
+ Qe s 2 (QQ), (BB). (A-8) 
oo a Zi we 


where the substitutions are obvious, 


The Response is bounded by an upper and Lower restriction 


which can respectively approach plus and minus infinity; 


(ke1 52,6 30) 


fy <¢ 


e- ty f 
Then, (A-9) can be restated as 


Y, 7 e720 
(k71,2,++.+,m) (A- 10) 
f- ¥, a0 
21 





or, uSing (A-l) and the transformation 


oe 
~ 


Y, = A, OX), (eet) 


of 
i 


a change of variables may be made so that 


Eo 0 (1=2,3,...,m¢1) 
(A- 12) 
F, = 0 (j=mt2,..., 2m¢ 1) 
Similarly, (A-8) may be transformed to 
Pe 
Byrne 2 at Ok Cae (A- 13) 
i=l i=l 


Equivalent quantities for the case where the number of 
variables, n, is equal to two are listed in Table IV. The 
equations (A-12) and (A-13), together with the bounds on the 


Kis constitute the form of the quadratic programming problem 


solved in Appendix B. 


TABLE IV 


EQUIVALENT QUANTITIES IN THE QUADRATIC PROGRAMMING PROBLEM 
FOR TWO _ VARIABLES 
Unknown Objective : 
Coefficients | Constants 






Constraint Constants 
Cee, 12, se) 









O 1 ra) 1 wo 
38 
B) Aa 2, % gre 
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APPENDIX B 


The FORTRAN code for selecting the experimental points 
(program DESIGN) and for finding the coefficients fo the quadratic 
equation by the method of bounded least squares (program FIT) is 
described Heres The production runs were made on a CDC 1604 
digital computer under COOP Monitor control. The programs allow 
considerable generality as written, and no attempt was made to 
"clean up" either one for the specific use of a bounded least squares 
fit, 

A general flow diagram is not considered essential to an 
understanding of either program DESIGN or FIT, Subroutines DIRECT, 
PATSER, EXPSER and SUMS comprise the Multiple Gradient Summation 
algorithm [3] used to solve the quadratic programming problem, 
Detailed flow charts for these routines are available from other 
sources, 

As presently programmed, a maximum of seven variables can 
be considered, On a 32K machine paaieloaal variables can be 
included if only one bound (upper or lower) is placed on the 
Response, Subroutines SUMS and GRAD must then be modified 
appropriately, 

athe algorithms given in [6] and [8] were modified and combined 
for this use, 


Spr, D. M, Himmelblau, The University of Texas, Chemical 
Engineering Department, Austin, Texas, 
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1, FORTRAN Nomenclature. 


Only the essential symbols used in the FORTRAN programs of 


this appendix are listed, 


A(T) 
AK 
ALN(T) 
ALO(TI) 


BZRO, BCI), 
BB(IJ) 


BO 
C(II) 


CINE (T) 


CK(LJ) 
DEL (TI) 
DELT 

EP(I) 


EV 


EX(I,J) 


F(T) 


FCHG 


FN 


The coefficients to be found, 
Orthogonality constant (K in Appendix A), 
The best set of coefficients found. 


Previous base value of ACI), 


Coded coefficients of the fitted response function. 
Coefficient (see REALB, REALC). 
Renumbered constants, 


Variable used to determine first negative 
constraint crossed, 


Renumbered constants, 

Incremental move for each A(I). 

Bound on the coded variables ( in App. A). 
Incremental change in A(I), 


Estimate of error variance of the fitted 
response values at the design points, 


Physical value of independent variable I 
in experiment J. 


The objective function (Residual) and the 
constraints, 


Minimum allowable fractional change in F(1) 
before a search failure occurs, 


Value of F(1) tested in types I and II 
exploratory searches, 


Value of F(1) calculated in subroutine SUMS, 
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FNEG(T) 


TACCEL 


INK 


ILATE (I) 
{TED 


ITER 


KCON 


KDAPT 


KFREQ 


KFREQS 


MQ 


The negative constraints when a non-feasible 
initiel guess of A(I) is made, 


Sum of squares of the residuals, 
Accelerating factor in the adaptive move. 


Frequency for printing values during a successful 
pattern move sequence, 


Latest constraint contacted during an adaptive move, 
Search failure counter, 
Pattern move failure counter, 


Used only in DIRECT and associated subroutines 
as the number of unknowns (coefficients) to find. 


Total number of constraints contacted in an 
adaptive move, 


Counter for the number of adaptive moves, 


Pattern move/exploratory search failure printout 
frequency, 


Successful pattern move printout frequency, 

Number of coefficients of the fitted response 
function (also number of each type of coefficients 
C and CK). 

If equal to 2, the number of search and pattern 
move failures/successes will be printed, 

If equal to 1, no printing will be done, 

Number of experiments, 


Counter for exploratory search failures, 


Counter for successive exploratory search failures, 
Used to reduce step size, 


Maximum number of allowable successful pattern moves, 
Number of independent variables (only for main 


programs DESIGN and FIT and subroutine REAL)- 
maximum of seven, 
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NC - 
NOMEX - 
NOPTN - 
NUMEX - 
NX = 
PARTIAL(I, J) 
PER(I) - 
PERC - 
Q0,Q(I), 
QQ(J) = 
REALB(I) , 
REALC(I,J) - 
RL, RU - 
SLOPE(I) - 
SUD (I) ~ 
TEST - 
VECTOR(I) - 
WAY - 
KCL) - 


Number of constraints plus one (only for sub- 
routines DIRECT, PATSER, EXPSER, SUMS, GRAD and 
OUTPUT) ~ equals 2M+ 1. 

Identifying case number. 

Counter for search failures, 

Counter for successful pattern moves, 


Counter for number of exploratory searches, 


Number of extra points at which to evaluate the 
fitted response function, 


Partial derivatives of F(I) with respect to A(J). 
DEL(I) equals PER(I)*ALO(I). 


Initial fractional incremental move for each A(I). 


Constants as defined in Appendix A, 


Coefficients of the fitted response function 
when physical values of the independent variables 
are used, (see BO also) 

Lower and upper bound on the Response, 


Factor used to convert to coded values of the 
independent variables. 


Number of successful successive search moves 
for each variable, 


If PER(I)< TEST, the problem has converged to 
a final answer, 


Sum of gradients of the contacted constraints 
in an adaptive move, 


Set equal to -1,0 to indicate that a minimum 
of the objective function is desired, 


Coded value of the independent variable [I in 
experiment L, 
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XAV (1) 


XMAX (I) 
YMIN (I) 
XX(I,L) 


Yq) 


YD (L) 
Y¥(L) 


z0,2(1), 
ZZ(J) 


Constant used to convert to coded values of the 
independent variables. 


Upper bound on the EX(I,J) for all J, 

Lower bound on the EX(I,J) for all J. 

Constants as defined in Appendix A, 

Observed response («xcept in subroutine PATSER), 
Temporary storage in subroutine PATSER. 
Residuals for each experiment, 


Computed value of the response function, 


Constants as defined in Appendix A. 


27 





2. Input for Program DESIGN. 


Card One 


Card Two 


FORMAT (212) .... .N, NC 


FORMAT (6E12.8) . . . .XMIN(I), XMAX(TI) 
punched in pairs for each variable, I = 1,N. 
Maximum of three pairs per card, 


3. Input for Program FIT. 


Card One 


Card Two 


Next Cards: 
(total of 
M cards) 


Next Cards: 


Next Card : 
Next Card : 
Next Card : 


Next Card : 


Next Card ; 
Next Card : 


Last Carde; 


FORMAT (215,E12.8) . .N, M, DELT 

FORMAT (6E12.7) . . . .SLOPE(I), XAV(I) 
Punched in pairs, I= 1,N. May require up 
to three cards for this data, 

FORMAT (8E10.3) ... .X(I,L) 

up to eight values of the independent var- 
lables for the Lth experiment. 

FORMAT (8E10.6) ... .Y(L) 

observed response for up to eight experiments 
per card, 

FORMAT (215,2E12.8) . .NC, NX, RU, RL 
FORMAT (80 character Hollerith title) 
FORMAT (15,F14.8) . . .MQ, PERC 


FORMAT (8E10,6) . .. .Initial guesses 
for values of the A(I). 


FORMAT (E10.6,215). . .TEST, LX, LY 
FORMAT (E10.6,215). . .FCHG, KFREQS, KFREQ 
FORMAT (8E10.6) . . . «EX(I,NX) 


Extra points to evaluate, Punch [ independent 
variable values per card; NX cards, 
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APPENDIX C 
SAMPLE COMPUT&R PRINTOUT FOR CASE ONE 


N= 2sM= 9sDELTA=1e00000000E 00 


i 


THE EXPERIMENTAL VALUES OF THE INOEPENDENT VARIABLES WITH THE 
CORRESPONDING CODED VALUES ARE 


FOR INDEPENDENT VARTABLE NUMBER 1 THE EQUATION FOR THE 


DESIGN POINTS IS EX=AX+Bs WHERE 


EXMIN= 0 AND EXMAX= 2-e0000000E 00 
A= 1e0000000E 00 AND B= 1e0000000E 00 
Bele X CODED — — =ea uments 
1 SI. COVOCOGE OO 0 
2 1.0000000E 00 2.00N00000E 00 
3 ~1.,0000000EF 00 . 0 
IA 1.0000000E 00 2.00000Q0F ON 
5 SOG O00UUE LOO 0 
6 0 1.00N0000E 00 
7 1e0000000E 00 2e0000000E 00 
8 0 1e0000000E 00 
9 0 1e0000000E 00 
FOR INDEPENDENT VARIABLE NUMBER 2 THE EQUATION FOR THE 
DESIGN POINTS IS EX=AX+Bs WHERE 
EXMIN= 0 AND EXMAX= 2-e0000000F 00 
A= 1e0000000E 00 AND B= 1-e0000000E 00 
EXPERIMENT - - - - X CODED - - - - EX REAL 
1 =1.0000000E 00 0 
2 -1.0000000E 00 0 
3 1-0000000E 00 2.0000000E 00 
4 1.0000000E 00 2e000N0N0E ON 
5 0 1e0000000E 00 
6 -1.,0000000E 00 | 0 
7 0. 1,0000000E 00 
8 1e0000000E 00 2.000N00NF 00 
9 0 1eO0000000E 00 
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